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(54) A method and system for updating replicated databases in telecommunication networks 

(57) A method and system for updating a replicated 
database in a foreign and home telecommunication net- 
work system to improve call setup time and system avail- 
ability in a foreign region for roaming customers is dis- 
closed. Customer records are updated in a visitor data- 
base contained in a foreign region within the signaling 
system of foreign telecommunications network. Informa- 
tion concerning the updated database record is transmit- 
ted from the visitor database through the signaling net- 
work of a home country to a home database which con- 
tains the repiicated version of the visitor database record 
in the foreign region. A field is added to the database 
record corresponding to a version number of the data- 
base record so as to identify the record referenced by ^ 
queries of calls in progress. The home database record 
at the home country is changed to reflect changes in the 
visitor database at the foreign region by using the version ^ 
number sequence while maintaining at all database sites 
the older version of the database record for query access 
until after completing the processing of all previous calls 
querying the database record. 
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Description 

This application is related to commonly assigned, 
copending patent application filed on even date by the 
same inventor and entitled "A Method And System For 
Updating Replicated Databases In A Telecommunication 
Network System." 

FIELD OF THE INVENTION 

This invention relates to a method and system for 
updating replicated databases in a foreign and home tel- 
ecommunication network system to improve call setup 
time and system availability to support global mobility of 
network customers in foreign regions. 

BACKGROUND OF THE INVENTION 

In the increasingly smaller world brought together by 
telecommunication networks, it is desirable to globalize 
a telecommunication network without building expensive 
transport networks in foreign countries. In fact, some 
countries will not allow domestic United States compa- 
nies to enter their foreign countries to build such net- 
works. Other expansive proposals for supporting global 
mobility include using satellites for locating mobile cus- 
tomers throughout the world. This design would be ex- 
pensive. 

No matter what type of global system is used, how- 
ever for certain mobile customers, the number of queries 
and updates corresponding for one record of a database 
would increase dramatically. Thus, it would be advanta- 
geous to distribute and replicate customer records in 
multiple geographical locations, i.e., sites, of various sig- 
naling networks of foreign countries for easy access, 
achieving a high level of efficiency and system availabil- 
ity as well as improved call setup time. 

SUMMARY OF THE INVENTION 

The features and advantages of the present inven- 
tion overcome the drawback of building expensive call 
transport systems in foreign countries. The system can 
be used with both wireless and wired networks of foreign 
counthes. 

In accordance with the present invention, a method 
and system for updating replicated databases in foreign 
and home telecommunication network systems to im- 
prove call setup time and system availability in a foreign 
region for roaming home network customers is dis- 
closed. A foreign region has a call transport system and 
switches for forwarding calls from a telecommunication 
station through the call transport system to a destination. 
A signaling system is operatively connected to the call 
transport system and includes a visitor database within 
the signaling system containing customer records for call 
routing and other signaling functions. 

A home signaling system of a home country has a 



home database. The visitor database is connected to the 
home signaling system. A customer record is updated in 
the visitor database. Information concerning the updated 
database record is transmitted through the home signal- 
5 ing network to the home database containing the previ- 
ous version of the database record. Means is responsive 
to the completion of all calls querying the previous ver- 
sion of both the visitor and home database record for de- 
leting the previous version of the database record. 
10 Queries are launched to the home database when 
calls are originated from the home country to network 
customers in the foreign region. Queries are launched to 
the visitor database when calls originate from the foreign 
region to a network customer. In one aspect of the inven- 
ts tion, current location information in the visitor database 
is maintained for highly mobile customers traveling in a 
foreign region. Identifiers contained within the home da- 
tabase directing calls to the visitor database for queries. 
The use of identifiers contained in the home database 
20 lessens the amount of constant updating to the home da- 
tabase. 

The record updating activity is recorded after an up- 
dated database record has been processed at the visitor 
or home databases. An acknowledgement is sent from 

25 the home database back to the visitor database after an 
updated database record has been processed within the 
home database. 

Multiple versions of customer records can be main- 
tained in the visitor and home databases so that queries 

30 for a call could access the same version of the associat- 
ed record for consistent routing and signaling informa- 
tion. Each updated record may include a version number 
of the record so as to identify the record referenced by 
queries of calls in progress. Records in the home data- 

35 base are updated by the version number sequence of 
the updated database records. Each version of a record 
includes a call counter field for indicating the number of 
ongoing calls whose queries have previously accessed 
that version of the record. The call counter field is incre- 

40 mented if a new call references to it and decrements the 
call counter field when a call setup is completed. The pre- 
vious version of the database record is deleted when the 
call counter is zero. 

45 BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing features and advantages of the 
present invention will be appreciated more fully from the 
following description, with reference to the accompany- 
50 ing drawings in which; 

Figure 1 is a block diagram of an illustrative embod- 
iment of the invention showing, a telecommunication 
service using the method and system of the present in- 
vention in a wired and wireless network. 
55 Figure 2 is a timing diagram for the primary-writer 
protocol in accordance with the present invention. 

Figure 3 is a timing diagram for a primary-site locking 
protocol. 
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Figure 4 is a timing diagram for a basic time-stamp 
protocol. 

Figure 5 is a graph showing a call misroute (or a 
two-site replication in accordance with the present inven- 
tion. 

Figure 6 is a graph showing a call misroute for a 
five-site replication in accordance with the present inven- 
tion. 

Figure 7 is a graph showing a call misroute for 
non-uniform traffic load in accordance with the present 
invention. 

Figure 8 is a block diagram showing a centralized 
database for global mobility using the protocol in accord- 
ance with the present invention. 

Figure 9 is a block diagram showing the use of dis- 
tributed, home databases for global mobility. 

Figure 10 is a block diagram showing an extended 
signalling network with replicated databases for global 
mobility. 

Figures 11 A and 11 B are flow charts showing the 
general method of the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention now allows replicated data- 
bases to be updated in a telecommunication network 
system to improve cost setup time and system availabil- 
ity without the overhead typically associated with such 
concurrency control protocols as primary-site locking 
and basic time-stamp protocols. 

In accordance with the present invention^ a custom- 
er record is updated in a primary site database within the 
signaling system of a telecommunication network, which 
includes a call transport system with switches for for- 
warding calls from a local telephone station through the 
call transport system to a destination. The information 
concerning the updated database record is transmitted 
through the signaling network to at least one secondary 
site database which contains the previous replicated ver- 
sion of the primary site database record. The customer 
record is changed at the secondary site to reflect chang- 
es in the database at the primary site. The older versions 
of the record are maintained at both primary and second- 
ary site databases for query access until after completing 
the processing of all previous calls querying the versions 
of the record at the database site. 

The replicated database design in accordance with 
the present invention can also be used to support global 
mobility. It can be applied to Universal Personal Tele- 
communications, Personal Communication Services 
(wired and wireless) and future global mobility services 
offered by Intelligent Networks. The design will provide 
a significant saving in transmission facility and operating 
costs, and minimize delays associated with call setup 
time. There is a shorter implementation time because the 
design with global implementation is based on current 
network infrastructure, requiring deployment of only a 
small amount of equipment. The design is also consist- 



ent with existing protocol standards. 

The proposed design for global mobility divides the 
world (besides the U.S.) into several regions typically 
covering several countries. To support global mobility, a 

5 single or multiple of home databases are installed in the 
U.S. and a visitor database is installed in each region. A 
record of signaling data of each customer is stored in the 
home database. If a customer is visiting a foreign coun- 
try, the customer record is also replicated in the visitor 

10 database of the visited region. Calls for the roaming cuj 
tomer originated from the U.S. and the visited region can 
be processed by the home and visitor database respec- 
tively. Because of local availability of signaling informa- 
tion in the visited region^ this design can reduce trans- 

?5 mission facilities and operating cost. Call setup time and 
response time of other signaling functions are also low- 
ered. 

Figure 1 illustrates an intelligent network, shown 
generally at 10, having a transport network^ indicated 

20 generally at 12, and signaling network such as the com- 
mon SS7 network 14. The transport network 12 includes 
a wired network 20, and could include a wireless network 
16 for mobile units 22. The transport network 12 con- 
nects to the local central office 23 and the local telephone 

25 station 24. 

The signaling network includes at least a primary 
site 26, which contains database records for routing pur- 
poses and other signaling functions. A secondary site 28 
is geographically spaced from the primary site 26 and 

30 includes replicated database records from the primary 
site 26: such as the illustrated Record A corresponding 
to general routing and signalling information for a cus- 
tomer. 

For purposes of understanding, a general overall de- 

35 scription of the system basics is set forth, followed by 
more detailed specifics. 

Since the distributed database issues are common 
to the PCN, the UPT services, and possibly other serv- 
ices involved in the use of databases (e.g., Network Con- 

40 trol Points, NCPs) in the IN, the general terminology for 
distributed database systems is adopted in the following 
specification. The computer system 30, 30a for respec- 
tive primary and secondary sites where parts of the da- 
tabase are located is referred to hereafter as sites. Cus- 

■^5 tomer recol-ds for call routing, features, service profiles, 
and other signaling information are called records. 
Reads and writes to the database are also referred to as 
queries and updates, respectively. To enable recovery 
from system failures (except disk crashes), each site 

50 keeps a log (also known as journal) of all updates made 
to the local database in a stable memory 36, 36a which 
can survive the failures. 

In accordance with the present invention used with 
telecommunication sen/ices, the database 26a consists 

55 of a collection of individual records, which are distributed 
and replicated at multiple sites, such as the secondary 
site database 28a. Queries associated with a call, and 
updates for a customer, access a particular record in the 
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database. Thus= the readset and writeset of a query and 
an update are one record. As a result, if queries and up- 
dates are processed atomically: unnecessary data in- 
consistency can be avoided. 

Furthermore, several queries may be launched to 5 
access the associated record during the call setup time, 
which typically lasts several seconds. Although the 
record may have been updated in the meantime, it is ad- 
vantageous not to immediately remove an obsolete copy 
of the record so that subsequent queries of the calls in 
progress can be processed in a consistent way accord- 
ing to the previous record. This eliminates the need for 
locking records for query processing without being con- 
cerned about data inconsistency. Additionally, calls will 
not be mishandled while the customer's record is updat- 75 
ed. This would be more difficult if the readset and writeset 
of queries and updates consisted of many records and 
files, as in the database systems of other applications. 

Because the readset and writeset consist ot one 
record, it is advantageous to treat records as the "unit" 
for distribution and replication at different sites. 

Since the readset (or writeset) of each query (or up- 
date) is one record, the concurrency control protocol 
must only maintain the internal and mutual consistency 
at the record level. With internal consistency, data items 
in each record at every site are always consistent. For 
example, the routing data in a record must be valid so 
that calls can be routed properly. Mutual consistency is 
preserved, if copies of a record replicated at different 
sites become identical in a finite amount of time after a 
number of updates have beeaposted to the record. The 
commitment protocol is designed to enable the system 
to recover from system failures, i.e., those updates that 
have been committed will not be undone. As illustrated 
below, the present invention provides a single protocol 
which performs the concurrency control and the commit- 
ment functions. 

The telecommunications system of the invention 
has basic operating parameters: 

a. All sites are connected by a signaling network and 
messages sent from one site to another may be lost 
in the network. Even if messages reach their desti- 
nation sites, they may not necessarily arrive in the 
order in which they are sent. 

b. Records of the database 26a are distributed and 
replicated at the sites. For example, a record (record 
A) is replicated at N sites, indexed by i = 1,2,...,N. 
To take advantage of load balancing, the initial que- 
ries of calls requiring access to record A are sent to 
those N sites according to some call distribution 
algorithm known. to those skilled in the art, such as 
the generalized round-robin algorithm, or a static 
scheme. To avoid unnecessary data inconsistency 
if a call setup involves multiple queries to the same 
record, subsequent queries of a call are routed to 
the same site where the initial query of the call is 



processed. 

c. Each site 26, 28 can keep multiple versions of a 
record so that queries for a call can access the same 
version of the associated record for consistent rout- 
ing and other signaling information. An obsolete ver- 
sion of the record is deleted after the process of all 
calls querying it has been completed. 

d. For recovery purposes, each site records the 
update activities in a log in stable storage, which can 
survive the system failures considered in this inven- 
tion. 

For each record A, one site with a copy of the record 
is selected as its primary site (PS) 26 and all other sites 
having a copy of the same record are referred to as the 
secondary sites (SS)28. (Note that the PS can also serve 
as the PS for many other records stored at this site. For 
simple implementations, this is likely the case.) Queries 
for record A are routed to the Primary Site 26 or any of 
the Secondary Sites 28 according to the call distribution 
algorithm in use. 

However, all updates for record A are first submitted 
to and processed by the primary site 26. If the processing 
of an update is completed without causing data incon- 
sistency, the update is committed at the primary site. 
Then, the information relating to the update is sent from 
the primary site 26 to all secondary site to update all rep- 
licated copies of the original database record. This con- 
currency control and commitment protocol is referred to 
as the Primary-Writer Protocol (PWP). 

To ensure the correct operations of the protocol, two 
fields are added to each record: 1) a version number 
35 (VN) and 2) a call counter (CC). The version number is 
used to identify the version of a record referenced by 
queries of calls in progress, while the call counter indi- 
cates the number of ongoing calls, that have previously 
accessed that version of the record. If the call counter is 
40 zero, and the record has been updated, the older version 
of the record is deleted. At any given time, there are prob- 
ably very few (e.g., two) versions of the same record ex- 
isting at a site because all setup time lasts only a few 
seconds and inter-update time is typically much longer 
45 than that. 

For purposes of understanding the details of the 
present invention, the following notations apply. RA(n) is 
the version of record A with the version number (VN) be- 
ing n for n = 0,1,2,..., and call counter, CC(n) denoting 
50 the CC of RA(n). Assume that R^iO) initially exists in the 
system. Further let vjate be the VN of the latest version 
of record A existing at a site. U„ denotes an update to 
record A, which successfully creates The prima- 

ry-write protocol of the present invention can be further 
55 described as follows. 

If the query for record A is the first query of a call, then 
begin 

Access RA(vn_late); (*Access to the latest 
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version of record A at the site*) 

Record the VN- vn_late. for the call: 
CC(vnJate) CC(vn Jate)+1 

end 
else begin 

Access Rp^in) that has been accessed by 
previous queries of the call; 

If the query is the last one of the call, 

then 

begin 

CC(n) ^ CC(n)-1; 

If CC(n)=0 and vn_late>n, then R^in) is de- 
leted 

end 
end 

The site is assumed to be capable of making the de- 
termination whether the query is the last one of the call. 
If the site does not have this capability, it is assumed that 
the site is notified by a separate message upon comple- 
tion of a call processing. In this case, the following oper- 
ations are performed when such a message is received: 

CC(n) ^ CC(n) -1, and 

if CC(n) = O and vn_late >n, then R^ (n) is 

deleted. 

Checking if CC(n) <0 prior to the operation of CC(n) 
<r~ CC(n)-1 can serve as a sanity check since CC(n)^0 
by definition. 

Details of processing an update for record A at the 
PS are as follows: 

If the update does not cause data inconsistency (e.g., 
due to incomplete routing data supplied by customers), 
then 

begin (*Update committed*) 

Create R^(vn_late+1) and set vn_late ^ 

vn_late+l : 



vn late 1+1: 



Record the committed update, U^njate- 



log: 



Record the committed update, U 



.. in the 



log; 



If CC(vnJate-1)=0, delete RA(vnJate-1 ); 
Send an update message, (U^njaie^ 
vn_late), to all secondary site's; 

Start a timeout period for the update U^^ i^^^ 

end 

else begin (*Update aborted*) 

Abort the update and inform the source 
end 

Details of processing an update for record A at a sec- 
ondary site / are as follows. 

For an update message (Ur^,n), compare n with vn_late 

at the site; 

If n>vnjate+1 then 

begin (*Updates arrive out of sequence*) 

Add the out-of-sequence update (U^.n) to a 
update list for record A, sorted in the ascending order of 
VN's for future processing 

end 

else if n = vn_late+1 then 

begin (*Update with the correct VN*) 

Process U|sg, create R^ln), and set vn_late ^ 



If CC(vnJate-1)=0, delete RA(vn_late-1 ): 
5 Send an acknowledgement with the VN 

vn_late and the site number i to the PS: 

Repeat this procedure to process the first up- 
date in the update list for record A if its VN equals 
vnJate+1 
10 end 

else if n<vn Jate then 

begin (*Duplicated update which has been 
previously processed*) 

Send an acknowledgement with the VN n 
IS and site number i to the PS 
end 

Details of acknowledgement processing for Record 
A at the PS are as follows. 

If the acknowledgement has been received before, 

20 it is discarded; othenwise, the acknowledgement for up- 
date from site I is recorded in the log; if all acknowl- 
edgements associated with have been received from 
all secondary sites 28, the timeout is deactivated and a 
"completion" message is sent to inform the source that 

25 all copies of record A have been updated successfully. 
Processing at Timeout Expiration for Record A at the PS 
is as follows: 

The update U is resent to those sites from which the 
associated acknowledgements have not been received. 

30 As noted before, all updates for record A are first 
processed by the primary sites 26. If an update causes 
any data inconsistency, it will be rejected (aborted) by 
the primary site 26: otherwise, the update is committed. 
The protocol of the present invention also preserves the 

35 internal consistency for all replicated copies of record A. 

I. If the copies of Ra(0) replicated at the primary site 
26 and all secondary sites 28 are identical and internally 
consistent, the protocol of the present invention main- 
tains the internal consistency for all replicated copies of 

40 record A. 

For example, consider a set of updates 
{U^;n=1 ,2,3,...} committed at the PS where maps R^^ 
(n-1) to RA(n). The mapping is denoted by RA(n)=Uf,(RA 
(n-1 )). Because Ra(0) is consistent and the Up's are com- 

-^5 mitted by the PS only if they cause no inconsistency, the 
RA(n)=U,(U„.i (...Ui(Ra(0))...)) for all n=1,2,3,... is al- 
ways internally consistent at the primary site 26. By use 
of the VN's, the protocol forces the U^'s to be posted at 
•each secondary site 28 in the same sequence in which 

50 they are committed by the primary site 26. Therefore, the 
internal consistency at the primary site 26 implies inter- 
nal consistency for record A at all secondary sites 28. 

The mechanism by which the protocol of the present 
Invention maintains record consistency is similar to that 

55 for an exclusive-writer protocol proposed in W.W. Chu 
and J. Hellerstein, "The Exclusive-Writer Approach To 
Updating Replicated File in Distributed Processing Sys- 
tems/' IE£EJlransa£t]ons_o^^ Volume C-34, 
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No. 6, June 1985. pp. 489-500. although the latter pro- 
tocol does not consider the delayed processing of 
out-of-order update messages, the failure recovery as- 
pects and the characteristics of telecommunication ap- 
plications. It should be noted that, once an update is 
committed by the primary site 26. it can always be com- 
mitted at the secondary sites 28. Thus, there is no need 
for database rollback. 

The method and system of the present invention 
also provides mutual consistency. If no additional up- 
dates are submitted to the system after a number of up- 
dates for record A have been sent to the pnmary site 2S 
all replicated copies of record A at the sites will eventually 
become identical in a finite time period, provided that all 
sites are operational perhaps after a failure for a finite 
amount of time. 

1 1. If the copies of Ra{0) replicated at the primary site 
and all secondary sites are identical the protocol of the 
present invention maintains the mutual consistency for 
all replicated copies of record A. 

Suppose that updates {Un;n=1 ,2,...,M} have been 
committed by the primary site and no further updates will 
be submitted. The use of VN's by the system and the 
method of the present invention forces the updates U^'s 
to be posted at all secondary sites in the sequence in 
which they are committed at the primary site. Since R;v 
(O) is identical at all sites, copies of Ra(M)» which equals 
Um (Um-i{ - ^^(RaIO))...)), at all sites are identical after 
updates {U^■,r^^^ .2.,...M] are processed by all sites. 

The system allows non-identical copies of records 
replicated at different sites to be available for call 
processing simultaneously. Thus, queries may access 
the obsolete information at some secondary sites while 
updates are pending for processing, thus causing call 
misroutes. As discussed before, if the probability of such 
occurrence is satisfactorily small, exclusive access to the 
records during updates is not needed. Without exclusive 
access, the system 10 is deadlock free. 

Furthermore, the system 10 does not require exten- 
sive message exchanges among sites which would oth- 
erwise be needed for concurrency control protocols such 
as locking to provide the exclusive access. Because a 
record is replicated at N sites, the total number of mes- 
sages exchanged between the primary site and the sec- 
ondary sites for each update is 2(N-1) at normal situa- 
tions. This is the minimum number of message exchang- 
es to support the degree of mutual and internal consist- 
ency needed for call routing and signaling. The system 
and method of the present invention can also be used in 
other applications as long as they can tolerate the record 
inconsistency, and the probability of referencing obso- 
lete data is kept at an acceptable level. 

The system of the present invention also has recov- 
ery ability, such as for the following situations. 

a. Loss of Messages and Link Failures: A loss of 
update and acknowledgement messages will cause 
the timeout to expire on the primary site. When this 
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happens, the primary site resends the update mes- 
sage to the sites associated with the lost messages. 

b. Site Failures: If the primary site fails before an 
update is committed in the log, the update is simply 
lost. The source discovers that if it does not receive 
a completion message from the primary site after a 
certain time period. In case the primary site fails after 
a committed update has been written in the log, the 
primary site can resume its operations after the fail- 
ure as if the update was just written in the log. 



As a result, the update is sent to all secondary sites 
again. For those secondary sites which have already 
IS posted the update successfully, they simply discard the 
duplicated update and send an acknowledgement back 
to the primary site. If a secondary site fails, the primary 
site resends the update, if any, to the failed site when the 
timeout associated with the update expires. 
20 After resending the update to a secondary site for a 
number of times, the primary site may declare the sec- 
ondary site no longer accessible. In this case, other re- 
covery procedures may be taken when the secondary 
sites resume operations. When the failed secondary site 
25 recovers, it can also resume its operations as if the last 
update was just written in the log and request the PS to 
resend all those updates completed during the failure. 

The system and method of the present invention is 
compared with two commonly used protocols: the Pri- 
30 mary-Site Locking (PSL) (Figure 3) and the Basic 
Time-Stamp (BTS) protocols (Figure 4). In addition, sev- 
eral numerical examples are presented to portray the 
typical performance characteristics of the system of the 
present invention (Figures 5-7). 
35 A fraction of calls may be misrouted by the method 

of the present invention because of accessing obsolete 
information at some secondary site databases, while up- 
dates are pending. The fraction of calls misrouted is a 
key performance measure for determining whether or 
40 not the method of the present invention is applicable to 
a particular application. 

As noted before, a record is first updated at its pri- 
mary site under the method. A vulnerable period is de- 
fined for the record at a secondary site as the time inter- 
ns val from the completion of an update to the record at the 
primary site until the time when the update is posted at 
the secondary site (Figure 2). As the most updated 
record has been available at the primary site at the start 
of the vulnerable period, queries accessing the record at 
50 the secondary site during the vulnerable period refer- 
ence obsolete data, thus causing call misroutes. Certain- 
ly, such misroutes will not occur, should there be no 
record replication. Figure 2 presents a timing diagram for 
the method of the invention. For example, the vulnerable 
55 period for update at the secondary site / is from time 
A to B. 

The length of a vulnerable period mainly depends 
on two factors: 1) the network delay incurred by an up- 
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date message sent from the primary site to the second- 
ary site^ and 2) the update response time (i.e.. time from 
the arrival of an update until its processing is completed) 
at the secondary site. These factors in turn depend on 
the characteristics of the signaling network, the design 
of each database, the traffic load, the ratio of query and 
update rates, and the service scheduling discipline for 
query and update processing. 

Based on a performance study with typical parame- 
ters in today's telecommunication networks, results in 
Figures 5-7 show that the fraction of calls misrouted un- 
der the method of this invention is satisfactorily small 
(e.g., less than 10""^) for a wide range of expected cus- 
tomer behavior (in term of call throughput and ratio of 
record read-write frequencies Rq) in the Personal Com- 
munication Networks (PCN), wireless networks, Univer- 
sal Personal Telecommunication (UPT) services and 
other advanced services to be offered by the Intelligent 
Networks (IN). 

Furthermore, when the method of this invention is 
compared with other concurrency control protocols such 
as the primary-site locking and the basic time stamp pro- 
tocols, Figures 3 and 4 show that since the method of 
this invention avoids extensive message exchanges re- 
quired by the existing protocols among database sites, 
it reduces the vulnerable periods, thus reducing the call 
misroutes. 

Referring now to Figures 1 1 A and 1 1 B, there is illus- 
trated a high level flow chart depicting the method of the 
present invention using the primary writer protocol of the 
present invention. 

As shown in block 100, the customer record at the 
primary site is first updated. The update is then checked 
for any data inconsistency in block 102. If there is an in- 
consistency, the update program is terminated in block 
1 04. If there is no data inconsistency, the update is then 
processed in block 106 and a new version of the record 
is created in block 1 08. The updated is committed in the 
log in block 110. The information relating to the update 
is then transmitted to databases at secondary sites in 
block 112. The secondary site updates by using the ver- 
sion number in block 114. Secondary site then creates 
a new version of the record in block 116. The update is 
committed in the log at the secondary site in block 118. 
If the call counter of the last version of the record is zero 
in block 120, then the old database record is deleted in 
block 122. Regardless whether the call counter is zero 
or not, the secondary site sends an acknowledgement 
to the primary site as the update has been successfully 
processed in block 124. The process continues with the 
next update in block 126. 

Replicated Database Design For Global Mobiiity 

The protocol of the present invention is also adapted 
for use with a replicated database design for supporting 
global mobility with wired and wireless networks, or a 
combination thereof. 



To support the sen/ice, personal., and terminal mo- 
bility. the communication network has to store, maintain 
and retrieve customers' mobility information for signaling 
purposes. This information includes that specified in the 

s reference environment of a customer (e.g., the charac- 
teristics of the terminal in use, the services subscribed, 
the location data and the call routing logic). Thus, a key 
challenge for the mobility management is to develop an 
efficient database architecture so that the mobility data 

TO can be readily available for signaling functions such as 
call setup and routing. 

The current approach to supporting the terminal mo- 
bility requires a home database (or Home Location Reg- 
isters, HLR) and a visitor database (or Visitor Location 

?5 Registers, VLR). This HLR-VLR architecture actually 
has been established as an industry standard in the Glo- 
bal System for Mobile Telecommunications (GSM) for 
Europe and the 18-41 recommendations for North Amer- 
ica. The home database can accessed by the fixed, 

20 vvired or wireless network, whereas the visitor database 
is connected to a switch (referred to as the mobile 
switching center, MSC) in the wireless network. The 
routing and other signaling functions of each call initiated 
from or destined for a mobile customer requires the use 

25 of the location information stored in the databases. The 
protocol and the associated architecture for supporting 
the terminal mobility are well defined, and understood by 
those skilled in the art. 

The notion of personal and service mobility is rela- 
te* tively new. As a result, the protocols and the architecture 
for the personal and service mobility are yet to be stand- 
ardized. The present invention is concerned with a sig- 
naling-network architecture based on replicated data- 
base for providing personal and sen/ice mobility io cus- 

35 tomers traveling throughout the world. 

In the following description, two alternative database 
architectural designs are examined, which might be 
adopted for mobility management. Due to the unique 
characteristics of global mobility, an extended signaling 

^0 network based on replicated databases to support global 
mobility is proposed. The applicability of the architecture 
to the personal and service mobility and its compatibility 
to the industrial standards for terminal mobility is set 
forth. The system performance and cost considerations 

^5 for the proposed architecture are also discussed. 

The system and method of the present invention can 
be applied to customer location information (i.e., routing 
data) of personal mobility. As explained below, the 
present invention can easily cover service mobility and 

50 reference environments, such as Universal Personal 
Telecommunications (UPT) services. In order for the IN 
to support the services, it has to rely on the extensive 
use of databases for call routing and other signaling func- 
tions. Each of the originating and receiving ends of a UPT 

55 call can be a wireless or wired terminal. 

An example of an existing database architectural de- 
sign to support the UPT services for customers traveling 
abroad is shown in Figure 8. The customer location in- 
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formation is stored in a centralized database 200 phys- 
ically located in the U.S. In order to make this design fea- 
sible, it requires: 

1 . Customers traveling abroad have to register from 
the visited country so that the network is informed of 
their current locations (e.g., in terms of POTS num- 
bers in wired networks, or mobile station roaming 
numbers in wireless networks). This location infor- 
mation for all customers subscribing to the UPT 
services is stored in the centralized database, which 
can be supported by a Network Control Point, NCR. 
Signal transfer points 204 in the U.S. network com- 
municate with signal transfer points 206 is country 

1 . and any other country in 21 0. Country 1 includes 
a VLR 212 connected to a MSG 214 in the wireless 
network 216. Country 1 also includes a wired net- 
work 218. Country n also includes similar elements 
referenced by prime notation. 

2. Every time a customer changes location , the loca- 
tion data (e.g., a POTS number in a wired network, 
or a pointer in the HLR pointing to the VLR 212 serv- 
ing the location area, a group of cells, where the user 
is located in a wireless network 216) tor the cus- 
tomer in the database is updated. Such database 
updates can be initiated: a) explicitly by customers 
connected to a wired network, as similar to the cur- 
rent 500 services, or b) automatically by the wireless 
network at which the customers are located. 

3. When a call is destined for a UPT customer 
located either in the U.S. or abroad, the signaling 
network queries the centralized database 200 for 
the location information for call setup and other sig- 
naling functions. 

The signaling network using distributed databases 
for mobility management is shown in Figure 9. In the de- 
scription that follows, elements common to those de- 
scribed in Figure 8 are given the same reference numer- 
als. In this distributed database design, customer 
records are partitioned and stored (but not replicated) at 
different physical locations, which can be interpreted as 
the customers' home locations 230. For this reason, the 
distributed database design is also referred to as the 
home database design. Actually, the centralized data- 
base design can be viewed as a special case of the dis- 
tributed design where all data is placed at a single loca- 
tion. On the other hand, the distributed databases offer 
potential advantages over the centralized design such 
as improved availability, reliability, and the flexibility of 
load balancing. 

This distributed database design can be used exten- 
sively for many services, e.g., Advanced 800 and Soft- 
ware Defined Network (SDN) services, where customer 
data for the same sen/ice is distributed and stored at mul- 
tiple NCP databases. Although each customer's record 



is stored at a primary and a secondary NCP for reliability 
reasons, only the primary copy is used for signaling func- 
tions at normal conditions and the secondary copy is 
treated only as a backup in case of failures. Thus the 
5 systems in use should be classified as the distributed de- 
sign. 

The major motivation for such wide use of distributed 
databases is to overcome the limitation of the processing 
power and memory constraint of each NCP. A single or 
10 at most a few databases (i.e., NCPs) are needed at the 
initial deployment of a new service. As the service de- 
mand grows, additional databases are necessary, thus 
making the centralized database design evolve into the 
distributed design. The assumptions and operations for 
15 call setup, routing and other functions for the distnbuted 
database design are identical to those for the centralized 
database design, as discussed above. For a given cus- 
tomer, the signaling networks or switches have the com- 
putational logic to determine which database among 
20 many contains the signaling data for the customer. 

Because a current signaling network provides a very 
high degree of connectivity, querying the distributed da- 
tabases across the U.S. does not cause unacceptable 
delays nor incur high costs for call setup and other sig- 
25 naling functions. The use of distributed databases will 
continue to be a viable approach. If the high connectivity 
is maintained in the future, there will not be a need to 
replicate customer records at multiple places for reduc- 
ing query delays and associated costs. However, this is 
30 not the case for signaling in other global areas, as antic- 
ipated for supporting global mobility in the future. In that 
situation, replicating customer records at a visitor data- 
base located at foreign countries will lower operating 
costs and shorten querying delays, as explained below. 
35 A signaling network based on replicated databases 
is shown in Figure 10, which illustrates basic use of the 
replicated database of the present invention for use in 
global mobility. Like reference numerals are use.gi for el- 
ements common to other units of Figures 8 and 9. 

40 

1. Depending on the anticipated traffic load and 
other engineering considerations, the world 
(besides the U.S.) is divided into several regions, 
each of which covers a number of foreign countries, 

45 such as the illustrated Region A 246 and Region B 

248 

2. A pair of visitor databases 2S0 are installed phys- 
ically in each region, and connected to the signaling 

50 network in the U.S., for example, via two additional 
STPs 252 physically located in that region. The 
number of STPs installed in a region and the number 
of signaling links connecting the STPs to the U.S. 
signaling network can be adjusted and determined 

55 according to the traffic, performance, and reliability 
requirements. 



3. In the registration process of a customer visiting 
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a foreign country, a record of location and other 
related signaling information for the customer is set 
up in the visitor database 250 for the region. This 
new information will also be sent back to update the 
associate home database 230 in the U.S. As a 
result, each roaming customer has two replicated 
copies of signaling data: one in the home database 
in the U.S. and the other in the visitor database phys- 
ically located at or close to the visited country. The 
record in the visitor database will be removed when 
the customer leaves the region. 

The replicated database can be accessed for call 
setup and other signaling purposes. For call originating 
from the visited country or region and destined for the 
roaming customers, queries can be launched to the vis- 
itor database. Calls initiated in the U.S. will query the 
home database. There are three major advantages for 
the use of replicated databases: 

1 . Substantial Cost Saving 

Due to local availability of needed customer data, 
the transmission cost for signaling messages for 
calls originated from the visited country or region can 
be saved. The saving will be substantial for: a) cus- 
tomers roaming half way around the world, b) calls 
requiring multiple queries into the database, which 
will likely be the case for advanced services in the 
future, and c) a majority of calls which originate from 
the visited country or region, which will also be the 
case for some business customers. Furthermore, as 
the number of messages sent over a long distance 
is decreased, the facility cost can also be reduced 
as fewer transmission facilities (e.g., signaling links) 
will be needed to support the same amount of call 
traffic. 

2. Enhanced Delay Performance 

Call setup time and response times for other signal- 
ing functions can be reduced. 

3. Compatibility with Existing Wireless Standards 
The replicated database design is compatible with 
the industry standards such as the IS-41 and the 
GSM specifications for wireless networks. The visi- 
tor database in a region can be treated as the HLR 
by the wireless network in the visited country. The 
rest of the standardized protocols for wireless net- 
works remain applicable. Upon receiving updates 
from a local wireless network, the visitor database 
is responsible for forwarding the updates to the 
home database in the U.S. to ensure customer data 
consistency in the home and visitor databases. 
Hence, the replicated database design indeed 
applies not only to wired services but also to wireless 
services. 

In accordance with the present invention consisten- 



cy must be maintained between the replicated copies of 
customer data stored in the home and visitor databases. 
The system and method of the present invention using 
the Primary-Writer Protocol (PWP) can be applied to 

5 the home and visitor databases for global mobility. The 
Primary-Writer Protocol of the present invention is ad- 
vantageous because telecommunication applications 
can tolerate inconsistency between replicated records 
for a short period of time. As noted above, the main con- 

10 sequence of accessing obsolete data is a call misroute. 
The performance analysis of the Primary Writer Protocol 
of the present invention establishes that the misroute 
probability under the present invention is small for the 
expected customer behavior in wireless networks and 

'5 IN. The present invention preserves both the internal and 
mutual data consistency, and also allows the system to 
recover from certain types of failures. The main advan- 
tage of the Primary Writer Protocol is its low overhead, 
especially when compared with existing protocols for 

20 computer systems (e.g. , banking systems), which are in- 
tended for maintaining stronger data consistency at all 
times. 

Using the Primary Writer Protocol of the present in- 
vention to support global mobility, the visitor database 

25 and the home database is designated as the Primary 
Site and Secondary Site, respectively for updating pur- 
poses. As noted above, this arrangement is appropriate 
because location updates and other changes of signal- 
ing information are most likely generated from custom- 

30 ers, who are roaming in the foreign countries. 

Although the above discussion focuses on the loca- 
tion information for UPT customers, it should be noted 
that the replicated database design actually applies well 
to service mobility and reference environments. The !o- 

55 cation information, the services subscribed, and the ref- 
erence environment are specified on a per customer ba- 
sis. Thus, the replicated database design and the asso- 
ciated protocols can treat the per customer information 
related to the subscribed services and other data items 

^0 included in the reference environment, in the same way 
as the location information. As far as the system perform- 
ance of the replicated database design is concerned, the 
only difference among various data items will be their 
query-to-update ratios (e.g. , the ratio of the querying rate 

•^5 to the location update rate for a UPT customer). 

Nevertheless, it is expected that the most frequently 
updated data item will probably be the location informa- 
tion for a mobile customer; the query-to-update ratios for 
other signaling data items will be higher than that for \o- 

50 cation data. As a result, the update algorithm of the 
present invention will also apply to customer records 
containing subscribed services, reference environment 
and other signaling information. 

A factor that may degrade the performance of the 

55 replicated design is the query-to-update ratio. If the ratio 
is high (i.e., the customer information is seldom 
changed), the overhead in updating the replicated 
records will be minimal. Otherwise (e.g., foramobilecus- 
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tomer moving from location to location), the update over- 
head can be significant. The following strategy will en- 
hance the performance of the replicated design, in such 
situations. 

A mobile, wireless customer is roaming in a foreign 
country. As a customer moves from one location area to 
another the customer location information in the visitor 
database is updated frequently. The corresponding cus- 
tomer record in the home database is also updated. 
Thus, the transmission and processing costs for main- 
taining the current location information in the home da- 
tabase will be significant, especially if the customer is 
located far away from the U.S. The situation will become 
even worse if the customer moves from location to loca- 
tion without making or receiving calls; i.e., no revenue is 
received to cover the cost incurred in handling the data- 
base updates. 

One way to reduce the overhead for location up- 
dates is to maintain the current location information for 
certain highly mobile customers only in the visitor data- 
base. The home database, in contrast, contains an iden- 
tifier pointing to the visitor database on which the current 
location information is stored, (i.e., the visitor database 
had the complete record of information associated with 
this roaming customer and the home database has only 
partial customer information.) 

As a result, the home database does not need to 
update the location information every time a customers 
changes its location overseas. Furthermore, calls origi- 
nated from the U.S., destined for a customer traveling 
overseas first retrieves the identifier from the home da- 
tabase and then accesses the current location informa- 
tion in the visitor database for call setup and other sign- 
aling functions. 

The enhancement approach for keeping complete 
customer data only in the visitor database not only ap- 
plies to the location information, but also applies to other 
data items with frequent updates. In addition, the en- 
hancement approach should be used on a per customer 
basis because different customers have different mobil- 
ity and calling patterns. As discussed above, the key pa- 
rameters for identifying these customers for whom the 
enhancement scheme may apply include: 

1 . The ratio of calls to the customer originated from 
the visited region to all calls destined for that cus- 
tomer 

2. The database query-to-update ratio (e.g., an indi- 
cation of mobility), and 

3. The ratio of cost for updating the home database 
(with update requests sent from the visited region) 
and that for remote querying the visitor database for 
calls originated from the U.S. 

Based on these parameters of each traveling cus- 
tomer, the signaling network can determine whether the 



enhancement approach should be applied to the cus- 
tomer (i.e., only the visitor database contains the cus- 
tomer's full record and the home database stores only 
parts of the customer data, which are less frequently up- 
5 dated). In fact, the approach can be applied to a custom- 
er dynamically on a regular basis, i.e, the network can 
turn on or off the approach periodically (e.g., every night) 
for a traveling customer depending on the customer's 
call throughput and update frequency statistics during 
w the previous period. 

In accordance with the present invention, the ex- 
tended signaling network based on replicated database 
has many benefits and can be viewed as a means to glo- 
balize the telephone network without actually building 
15 transport networks in foreign countries, which the tele- 
phone companies in the United States often are not al- 
lowed or prefer not to do. Yet, the replicated database 
design in effect makes use of foreign networks to support 
global mobility for network customers. 
20 The replicated design costs less to implement than 
other system methods such as the employment of satel- 
lites for locating mobile customers throughout the world 
(i.e., global, terminal mobility). More importantly, the sys- 
tem of the present invention is based on the current in- 
25 frastructure of wired and wireless networks, and it con- 
forms with existing standards of cellular networks. Thus, 
the replicated design not only reduces the operating 
costs and calls setup delay when compared with other 
alterative database designs, but also enables the United 
30 States telephone network to offer global mobility servic- 
es to customers sooner 

The proposed design can also help the U.S. network 
compete with some foreign telephone companies. The 
network may choose to allow access to the visitor data- 
35 base only by (wired and wireless) networks of existing 
business partners; competitors' networks will not be pro- 
vided with the signaling information stored and used in 
the visitor database. 

As a result, for calls originated in a foreign country 
40 and destined for a network roaming customer only net- 
works of the company in question are equipped to carry 
the calls. Such an arrangement can also be used to en- 
hance the U.S. network's position in partnering with serv- 
ice providers overseas. In another business arrange- 
45 ment. the telephone network may also choose to furnish, 
for a fee, some foreign carriers with certain signaling in- 
formation to carry calls destined for the network custom- 
ers traveling in the country. Furthermore, if the telephone 
network can work with its business partners abroad, the 
50 replicated database design can be implemented in an 
alternative way. 

If an arrangement between the telephone network 
and its business partner overseas can be made, instead 
of installing network visitor database and STPs in a for- 
55 eign country, records of network customers traveling in 
the country can be downloaded directly from the home 
database to a database in the partner's network. Conse- 
quently, as in the original replicated database design, 
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foreign region. 

5. The nnethod according to claim 1 including the step 
of rennoving records from the visitor database when 

5 the associated network customers leave the foreign 

region. 

6. The method according to claim 1 including commit- 
ting the updated record of the visitor and home data- 

to bases by recording the updated record activity in a 
log in a stable data storage area after the updated 
database record has been processed and commit- 
ted at the visitor and home databases respectively. 

?5 7. The method according to claim 1 including sending 
an acknowledgement from the home database back 
to the visitor database when an updated database 
record has been processed within the home data- 
base. 

20 

8. The method according to claim 1 including the step 
of maintaining current location information in the vis- 
itor database for highly mobile customers traveling 
in the foreign region and maintaining an identifier in 

25 the home database directing calls to the visitor data- 
base for queries. 

9. The method according to claim 8 including the step 
of maintaining the identifier in the home database 

30 directing the calls to the visitor database for querys 
on a per customer basis. 

10. The method according to claim 1 including maintain- 
ing multiple versions of records in the home and vis- 

35 itor databases so that queries for a call can access 
the same version of the associated record in the 
same database for consistent routing and signaling 
information. 



each traveling customer continues to have two copies of 
his or her information for signaling purposes. The proto- 
cols and operations for the replicated design remain ap- 
plicable to this new setting, although a United States tel- 
ecommunications network does not physically own visi- 
tor databases and STPs in that country. 

It is to be understood that the above description is 
only one preferred embodiment of the invention. Numer- 
ous other arrangements may be devised by one skilled 
in the art without departing from the scope of the inven- 
tion. 



Claims 

1. A method for updating a replicated database in for- 
eign and home telecommunication network systems 
to improve call setup time and system availability in 
a foreign region for roaming customers comprising 
the steps of 

updating the customer record in a visitor data- 
base contained in a foreign region within the signal- 
ling system of a foreign telecommunication network, 
wherein the telecommunications network includes a 
call transport system with switches for forwarding 
calls from a local foreign station through the call 
transport system to a destination, 

transmitting information concerning the 
updated database record from the visitor database 
through the signaling network of a home telecom- 
munication system to a home database which con- 
tains the replicated version of the visitor database 
record in the foreign region, 

adding a field to the database record corre- 
sponding to a version number of the database 
record so as to identify the versions of the records 
referred by queries of calls in progress, and 

changing the home database record at the 
home country to reflect changes in the visitor data- 
base at the foreign region by using the version 
number sequence, while maintaining at all database 
sites the older version of the database record for 
query access until after completing the processing 
of all previous calls querying the version of the data- 
base record. 

2. The method according to claim 1 including launching 
queries to the home database when calls are origi- 
nated from the home country to network customers 
in the foreign region. 

3. The method according to claim 1 including launching 
queries to the visitor database when calls are origi- 
nated from the foreign region to a customer. 

4. The method according to claim 3 including directing 
the query to the home database for accessing the 
customer record if the customer is not roaming in a 



40 11. The method according to claim 1 including deleting 
the previous database record version at all database 
sites after completing the processing of a|l calls que- 
rying the previous version of the database record. 

45 1 2, The method according to claim 1 including adding a 
field to the record corresponding to a call counter to 
indicate the number of ongoing calls whose queries 
have previously accessed that version of the record. 

50 13. The method according to claim 12 including incre- 
menting the call counter field by one if a new call 
references to it, and decrementing the call counter 
field by one when a call setup is completed. 

55 14, The method according to claim 1 3 including deleting 
the previous obsolete database record when the call 
counter is zero. 
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15. The method according to claim 1 including the step 
of verifying the updated database record in the vis- 
itor site database for data inconsistency. 

16. The method according to claim 1 wherein the call 
transport system of the foreign region includes a 
wireless phone network and wired phoned network. 

1 7. A system for updating replicated database in foreign 
and home telecommunication network systems to 
improve call setup time and system availability in a 
foreign region for roaming customers comprising 

a foreign telecommunication system situated 
in a foreign region and having a call transport system 
and switches for forwarding calls from a telecommu- 
nication station through the call transport system to 
a destination, 

a signaling system operatively connected to 
the foreign call transport system^ and including a vis- 
itor database within the signaling system containing 
customer records for call routing and other signaling 
functions, 

a home telecommunication system having a 
home signaling system and home database, said 
visitor database being connected to said home sig- 
naling system, 

means for updating a customer record in the 
visitor database, 

means for transmitting information concerning 
the updated database record through the home sig- 
naling network to the home database containing the 
previous version of the database record, and 

means responsive to the completion of all calls 
querying the previous version of both the visitor and 
home database record for deleting the previous ver- 
sion of the database record. 

18. The system according to claim 17 including means 
for launching queries to the home database when 
calls are originated from the home country to net- 
work customers in the foreign region. 

19. The system according to claim 17 including means 
for launching queries to the visitor database when 
calls are originated form the foreign region to a net- 
work customer. 



the visitor and home databases respectively. 

22. The system according to claim 17 including means 
for sending an acknowledgement from the home 

5 database back to the visitor database after an 

updated database record has been processed 
within the home database. 

23. The system according to claim 17 including means 
10 for maintaining multiple versions of customer 

records in the visitor and home databases so that 
queries for a call can access the same version of the 
associated record in the same database for consist- 
ent routing and signaling information. 

15 

24. The system according to claim 17 wherein each 
updated record includes an identifying field corre- 
sponding to a version number of the record so as to 
identify the record referenced by queries of calls in 

20 progress. 

25. The system according to claim 24 including means 
for updating the records in the home database by 
the version number sequence of the updated data- 

25 base records. 

26. The system according to claim 17 wherein each 
updated record includes a call counter field for indi- 
cating the number of ongoing calls whose queries 

30 have previously accessed that version of the record. 

27. The system according to claim 26 including means 
for incrementing the call counter field by one if a new 
call references to it, and means for decrementing the 

35 call counter field by one when a call setup is com- 
pleted. 

28. The system according to claim 27 including means 
for deleting the previous database record when the 

40 call counter is zero. 

29. The system according to claim 17 wherein said call 
transport system of the foreign region includes a 
wireless phone network and a wired phone network. 

45 



35 



20. The system according to claim 17 including means 
for maintaining current location information in the 
visitor database for highly mobile customers so 
traveling in a foreign region, and an identifier con- 
tained within the home database directing calls to 

the visitor database for queries. 

21 . The system according to claim 1 7 including storage ss 
means for recording updated record activity at the 
visitor and home databases after the updated data- 
base record has been processed and committed at 
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